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Abstract 

The stochastic MV-PURE estimator has been developed to provide linear esti- 
mation robust to ill-conditioning, high noise levels, and imperfections in model 
knowledge. In this paper, we investigate the theoretical performance of the 
stochastic MV-PURE estimator under varying level of additive noise. More 
precisely, we prove that the mean-square-error (MSE) of this estimator in the 
low signal-to-noise (SNR) region is much smaller than that obtained with its 
full-rank version, the minimum-variance distortionless estimator, and that the 
gap in performance is the larger the higher the noise level. These results shed 
light on the excellent performance of the stochastic MV-PURE estimator in 
highly noisy settings obtained in simulations so far. We extend here previously 
conducted numerical simulations to demonstrate a new insight provided by re- 
sults of this paper in practical applications. 

Keywords: robust linear estimation, reduced-rank estimation, stochastic 
MV-PURE estimator, array signal processing 



1. Introduction 

The linear estimation of an unknown random vector of parameters in lin- 
ear regression model has been a subject of a continuous research, amplified 
by widespread usage of the linear model y = Hx + y^en (e.g., in brain signal 
processing fil S and wireless communications [U), close link with array signal 
processing [4|],[a, Sec. 1.2], and low computational cost associated with linear 
estimation. In particular, the search for linear estimators more robust to ill- 
conditioning, high noise levels, and imperfections in model knowledge than the 
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theoretically optimal [in the mean-square-error (MSE)sense] linear minimum- 
mean-squre-error (MMSE) estimator (Wiener filter) Id, Ml has long attracted 
researchers and practitioners attention, see e.g., [1, S Efl EH E3 for an overview 
and recent solutions. One of the natural ways to increase robustness is to derive 
an estimator with carefully chosen additional constraints, resulting in an estima- 
tor which is theoretically suboptimal compared to the unconstrained solution, 
but achieves better performance in certain settings of interest (e.g., where only 
a finite sample estimate H of a model matrix H is available in the linear model 
y = Hx + \/en) . An example of this approach is an estimator W minimizing 
MSE subject to the so-called distortionless constraint WH = I which has been 
recently used as a robust solution for estimation of an unknown random vector 
[3|, LL3( , and which is essentially equivalent to the celebrated best linear unbiased 
estimator (BLUE) 7] in deterministic estimation^] Another provably robust 
technique is the reduced-rank approach 14 , ljj ljl E3, El, Ell > vei 7 useful in ill- 
conditioned and highly noisy settings, as it introduces (usually a small amount 
of) bias in exchange for huge savings in variance, and in the adaptive case, 
it provides further benefit of usually lower computational load on the filtering 
process. 

Thus, it would seem natural to extend the distortionless approach of the 
stochastic BLUE estimator to the reduced-rank case in order to achieve greater 
robustness to ill-conditioning, high noise levels, and imperfections in model 
knowledge. This has been achieved by introduction of the minimum-variance 
pseudo-unbiased reduced-rank estimation (MV-PURE) framework firstly pro- 
posed and solved in deterministic case in [2(1, and solved in the generalized 
formulation in deterministic case in [2l|, and extended to stochastic case in 



221 ] . In this framework, the solution to an inverse problem of linear estimation 



of deterministic or random vector of parameters in linear regression model is 
derived as a rank-constrained solution of a hierarchical optimization problem, 
where, for a given rank constraint, the aim is to suppress bias (by simultane- 
ous minimization of all unitarily invariant norms of an operator applied to the 
unknown parameter vector), and then to find among such estimators the one 
with minimum variance in deterministic case, and the one with minimum MSE 
in stochastic case. 

However, in order to compare robustness properties of estimators consid- 
ered, it is beneficient to compare their performances first in the theoretical case 
of perfect model knowledge. Then, aided with theoretical results serving as a 
benchmark, one would be able to determine the performance degradation of a 
given estimator (i.e., its robustness properties) in the presence of model uncer- 
tainties. Focusing on the stochastic MV-PURE estimator, we define conditions 
under which its rank reduction technique enables it in the theoretical settings 
of perfect model knowledge to achieve significantly lower MSE than its full-rank 
version, the stochastic BLUE estimator. The main result of this paper achieves 
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this goal as it shows that the larger the power of additive noise, the larger 
the gap in performance between stochastic MV-PURE and stochastic BLUE 
estimators, and that the optimal rank is in fact monotonically decreasing with 
increasing noise level. These results indicate a common intuition that insistence 
on distortionless is an inadequate requirement in highly noisy conditions: the 
results of this paper derive conditions when this intuition is true. Furthermore, 
the results of this paper demonstrate clearly an interplay between noise levels 
and ill-conditioning of the model considered, which gives further insight into the 
scope of applicability of the stochastic MV-PURE estimator. We provide a nu- 
merical example, where we demonstrate a new insight and interpretation of the 
numerical simulations considered first in 22j , where we employed the stochastic 
MV-PURE estimator as a linear receiver in a multiple-input multiple-output 
(MIMO) wireless communication system. 

This paper expands results presented in part at conferences 23|, 24 1 . 



2. Preliminaries 

2.1. Stochastic linear model 

In this paper we consider stochastic linear model of the form [f| @] 

y = Hx + Ven, (1) 

where y, x, n represent observable random vector, random vector to be esti- 
mated, and additive noise, respectively, and where H £ R™ xm j s a known ma- 
trix of rank to, and e > is a known constant. We assume that x and n have 
zero mean and are uncorrelated, R xn = 0, and that R x >- and R n >- are 
known positive definite covariance matrices of x and n, respectively (by A >- 
we mean that matrix A is positive definite). From the previous assumption, 
R y = (HR x H'+eR n ) >~ and R xy = R X H* are available and ranfc(R xy ) = to. 
We define the norm of a random vector x by || x ||= y/tr [E(xx')] = J tr [R x ] 
and we assume without loss of generality that tr[R n ] = 1 so that || y/en || 2 = e. 

We consider the problem of linear estimation of x given y with the mean- 
square-error as the performance criterion. Thus, we seek to find a fixed matrix 
W £ M mxn , called here an estimator, for which the estimate of x given by 

x = Wy (2) 

is optimal with respect to a certain criterion related to the mean-square-error 
(MSE) of x: 

J(W) =|| x - x || 2 = ir[WR y W 4 ] - 2tr[WR yx ] + ir[R x ], (3) 

where as above R y and R x are the covariance matrices of y and x, respectively, 
and where R yx is the cross-covariance matrix between y and x. 
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2.2. MMSE, stochastic BLUE, and stochastic MV-PURE estimators 

The unique solution to the problem of minimizing ([3]) is the linear minimum 
mean-square-error estimator (MMSE) Wmmse, often called the Wiener filter, 
given by @, 0] 

Wmmse = R xy R y 1 = R X H*(HR X H* + eR^)" 1 . (4) 

However, as discussed in Section [TJ the search for linear estimators un- 
der MSE criterion does not end here, certain solutions more robust to ill- 
conditioning, high noise levels, and imperfections in model knowledge need to 
be derived. The robustness of linear estimators having MSE ([3]) as the cost 
function can be greatly improved by adding constraints. An example of this 
approach is the stochastic BLUE estimator which is often called the distortion- 
less MMSE estimator and has been widely employed in recent signal estimation 
and detection schemes 0, [l3| and which is defined as a solution to the linearly 
restricted problem Q: 



minimize J(W) 
subject to WH = I ri 



(5) 



with the unique solution 

W BLUE = (H*R y 1 H)- 1 H'R y 1 = (H f R n 1 H)- 1 H*R n 1 . (6) 

The stochastic MV-PURE estimator introduced in [22] is a reduced-rank 
extension of the approach ([5]) , as it achieves the smallest distortion among all 
reduced-rank estimators!! More precisely, the stochastic MV-PURE estimator is 
defined as a solution to the following problem for a given rank constraint r < m: 

minimize J(W r ) 

subject to W r G P| "Pi., ( 7 ) 



where 



i&3 



7>; = arg min || W r H - I m \\*, i G 3, (8) 



where X" ixn := {W r G M. mxn : rank(W r ) < r < m} and where 3 is the in- 
dex set of all unitarily invariant norms. We recall here that a matrix norm 
i is unitarily invariant if it satisfies || UXV || t =|| X || t for all orthogonal 
U £ l mxm , V G M™ x " and all X e M mx ™ [25] [the Frobenius, spectral, and 
trace (nuclear) norm are examples of unitarily invariant norms] . The following 
Theorem provides a closed algebraic form of the stochastic MV-PURE estima- 
tor. 



2 We note that in deterministic case, the condition WH = I m in J5j implies unbiasedness 
of the estimator Wblue ©. 
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Theorem 1 ([22]). Consider the optimization problem . The following holds: 

1. Assume that rank r is constrained to r < m and define the symmetric 
matrix K by 

K:={lfR v 1 ti)' 1 -2R x . (9) 

Let the eigenvalue decomposition of the symmetric matrix K be given 
by EVD(K) = EAE 1 , with eigenvalues 5% < 8% < • • • < 5 m orga- 
nized in nondecreasing order, and ej denotes the eigenvector associated 
with the eigenvalue Sj. Then the solution to problem ([7J) 7 denoted by 
WImv-pure G K mx " ; is given by 

VKmV-PURE = ErE^WsLUE, (10) 

where Wblue is defined in and E r := (ei, . . . ,e r ). If 5 r ^ S r +i, the 
solution is unique. Moreover, we have: 

r 

J ( VKmv-pure ) = ^2S i + tr[R m ]. (11) 

i=l 

2. If no rank constraint is imposed, i.e., when r = m, then the solution to 
problem Pfy is uniquely given by W^mv—pure = Wblue- In particular, 
we have: 

m 

HWTmv-pure) = HWblue) = ^5i + tr[R^. (12) 

i=l 

The following Remark follows directly from Theorem [T] and will be useful 
later on. 

Remark 1. Let us set rank constraint r < m. We have 

^{Wsmv-pure) < J(WImv-PURe) < 
-pure) — 

J(W BLUE ) <F=>6 r+1 >0. (13) 

In particular, the optimal rank r opt of the stochastic MV-PURE estimator, for 
which J( W r °^fy _ PURE ) is the smallest, is such that 

r opt = max{s € {1, 2, . . . , m} | 6 S < 0} . □ (14) 

2.3. Variational characterization of eigenvalues of symmetric matrices 

The following theorem due to Weyl shows how eigenvalues of A + B compare 
to eigenvalues of A, where A,BG ]^ mxm are symmetric matrices. This result 
will play an important role in derivation of the results of Section [3J 

Fact 1 (Weyl jH, p.181]). Let A,B € W nxm be symmetric matrices, and 
let the eigenvalues Xi(A), Xi(B), and Xi(A + B) be organized in nondecreasing 
order. For each k — 1,2, ... , m we have: 

\ k {A) + Ai(.B) < \ k (A + B) < X k {A) + X m (B). (15) 
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3. Performance analysis under varying levels of signal-to- noise 
ratio 

We note first the following Lemma which gives us an alternative expression 
of matrix K defined in ©. It will be used below to prove the main results of 
this paper. 

Lemma 1. With notation as in model (QJ), the following equality holds: 

{tfR- 1 !!)- 1 =e(H t R n 1 IT)- 1 + R X7 (16) 

and thus K (0) in Theorem^ can be expressed as: 

K= (rfRy'Hy 1 -2R x = e(H t R n 1 Hy 1 - R x . (17) 

Proof: Let us recall that in model ([TJ we have R xy = R X H* (and therefore 
R yx = HR X ), and consider the covariance matrix 

E [(Wy - x)(Wy - x) 4 ] = WR y W* - WHR X - R X H*W* + R x . (18) 

By inserting the first expression of W B lue = (H*R y 1 H)" 1 H*R y 1 © into ([18]) 
we obtain E [(W BLUE y - x)(W BLC/E y - x)<] = (H'Ry 1 !!)- 1 - R x . How- 
ever, since R y = HR X H* + eR n , from the second expression of Wblue — 
(H f R n 1 H)~ 1 H*R n 1 (|6|) we obtain from ([T8f also the alternative expression 
E[(W BLC/s y-x)(W BL[/£ y-x)*] = e^'R^H)" 1 . □ 

The following Theorem demonstrates the usefulness of the reduced-rank ap- 
proach of the stochastic MV-PURE estimator in highly noisy settings. 

Theorem 2. Let EVD(H t R n 1 H) = MTM* be an eigenvalue decomposition 
of 

rfR^HyO, (19) 

with eigenvalues Vi > v% > • • • > v m > 0. Moreover, let EVD(R X ) — iVTiV* be 
an eigenvalue decomposition of R x y with eigenvalues 71 > 72 > ■ • • > 7,„ > 
0. Then, for each rank constraint r < m, if the power of additive noise e is such 
that: 

e > w r+ i7i (20) 

then: 

J(w r sMV _ PURE ) < J(W s ~li V _p URE ) < 

• • • < J( VCmv-pure) = J( W BLUE ). (21) 

In particular, relation between \20\) and V21\) guarantees that the reduced-rank 
approach of the stochastic MV-PURE estimator enables it to achieve lower 
mean- square- error than of the stochastic BLUE estimator for all e > w m 7i- 
Moreover, if: 

Vrlm > £ > Wr+l7l (22) 

then r — r opt = max {s£ {1,2,..., m} \ 5 S < 0} . 
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Proof: From our assumptions, we have EVD[(H t 'R~ 1 li)~ 1 ] = MY^M* 
with eigenvalues < uf 1 < v^ 1 < ■ ■ ■ < v' 1 , and EVD(-H X ) = N(-r)N* 
with eigenvalues —71 < —72 < • • • < —7™ < 0. Thus, if we denote an eigenvalue 
decomposition of K = e (F^R^H)" 1 - R x (TTT]) by EVD(K) = EAE*, with 
eigenvalues Si < 62 < • • • < 5 m organized in nondecreasing order, from Fact [TJ 
in Section POl upon setting A = e(H t R n 1 H) _1 and B = — R x , we obtain for 
each s = 1, 2, . . . , m 

ev^ 1 - 71 < S s < ev~ x - 7 m . (23) 

Therefore, from the first inequality above it is seen that condition (|20l) ensures 
S r+ i > 0, which in view of (TT31 is equivalent to ([2"T1) . Similarly, if e satisfies the 
more stringent condition (|2"2"1) . then not only S r +i > 0, but also 5 r < 0, which 
in view of (1141) implies that r — r opt . □ 

We note that Theorem [5] provides an insight into an interplay between 
ill-conditioning of H'R" 1 !! and noise power e. Namely, for fixed R x >- 0, if 
H^R^H has a large condition number defined as the ratio of the largest eigen- 
value to the smallest, e.g., if it possesses some vanishingly small trailing eigen- 
values, then in such settings it suffices for the noise power e to be relatively very 
small for the reduced-rank approach to be useful, in the sense of relation given 
by ©-(EH). 

It should be also noted that Theorem [5] can be easily generalized, e.g., by 
simply swapping the roles of A and B in the Proof of Theorem [21 which would 
give (in virtue of Fact [TJ in Section 12.31) pairs of bounds on the eigenvalues of 
K, alternative to those stated in ([2"3")l . Indeed, many different alternatives to 
the bounds presented in (|23[) can be obtained by applying the more general 
Theorem 4.3.7 in [2^, pp. 184-185], of which Fact Q] in Section [231 is a special 
case. Nevertheless, bounds (|23|) used in the Proof of Theorem [2] give in our 
opinion naturally interpretable conditions (f20|) and (|22|) . 

However, conditions ([2"2"1> do not guarantee that the optimal rank of the 
stochastic MV-PURE estimator is the lower the larger the power e of additive 
noise, for the general case of a not necessarily white input vector x. This goal 
is achieved in the following Theorem. 

Theorem 3. For fixed R x >- and R n >~ in the stochastic linear model in 
Sec \2.1\ the optimal rank of the stochastic MV-PURE estimator (for which it 
achieves the smallest MSE among all rank constraints) is monotonically decreas- 
ing with increasing power e of the additive noise. 

Proof: Let us denote first an eigenvalue decomposition of matrix K = 
e (B^R^H)" 1 - R x CE} by EVD(K) = EAE*, with eigenvalues S t < S 2 < 
■ ■ • < dm organized in nondecreasing order. We recall from Remark [T] that a 
rank constraint r opt is optimal in our sense if it satisfies 

r opt = max{s G {1, 2, . . . , m} | 8 S < 0} . 

We will show now that all eigenvalues of K grow monotonically with increasing 
e which is a sufficient condition for the claim in the Theorem since in such a 
case r opt can only be monotonically decreasing with increasing e. 



7 



To this end, denote by Afc(X) the eigenvalues of a given symmetric matrix X 
organized in nondecreasing order and consider e\ > eo > so that 

e 1 (H*R n 1 H)- 1 -R x = A + B, (24) 

where A = eo^R" 1 !!)- 1 -R* and B = e 2 (H*R n 1 H)~ 1 with e 2 = ei-e > 0. 
Note that B so defined is a positive definite matrix, thus all eigenvalues of B 
are strictly positive. Hence, from the first inequality in Fact [T] in Section [231 we 
obtain that 

Vfc = l,...,m A fc [e^H'R^H)- 1 - R x ] > A fe ^(H'R-^)- 1 - R x ] + 

Ax ^(H'R^H)- 1 ] > A fc [^(H'B^H)- 1 - R x ] , (25) 

which completes the proof. □ 



4. Numerical example 

In digital signal processing applications, the following setup is frequently 
considered: 

y c = H c x c + \/en c , (26) 

where H c £ i^nxm j g a com pi ex Gaussian channel between input signal x c £ C A/ 
and output signal y c £ C N corrupted by additive Gaussian noise n c £ C N . 
Then, the task is to estimate linearly x c by x c = Wy c under MSE criterion. 

We set N = M = 8 and assume zero-mean temporally white circular Gaus- 
sian noise random vector with spatial covariance matrix R n<: >- 0, where the 
entries of H c are zero-mean i.i.d. Gaussian random variables of unity vari- 
ance, and where input signal x c is independent from noise (thus Rx c n c = 
£ M. MxN ) and consists of symbols drawn uniformly and independently from 
QPSK={1 +i, 1 — i, — 1 + — 1 — i} constellation. We define signal-to- noise ratio 
(SNR) as: 

SNR = % . = -, (27) 
etr[R nc ] e' v ' 

where <j\ = 1 is the variance of the elements of H c and where we assume without 
loss of generality that tr[R n J = 1. The noise covariance matrix R„ c is the same 
throughout the remainder of Section 01 and we assume below that Q = 200 data 
blocks have been transmitted. 



In [22j, the effectiveness of the stochastic MV-PURE estimator was demon- 
strated in a scenario of a multiple-input multiple-output (MIMO) wireless com- 
munication systems. However, it was unclear how the power of the additive noise 
and ill-conditioning of the model considered affect performance of the stochastic 
MV-PURE estimator, especially compared to its full-rank version, the stochas- 
tic BLUE estimator. Thanks to the results of Section [3l we can answer these 
questions below. 
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To this end, let us first cast the complex model (|26l) into its equivalent 
real- valued representation: 

y = ( fm(y c ) )' n = ( fm(n c ) ) X = ( fm(S) )' (28) 

and: 

"i"?) 1 )• R - = 1/2 ( S o"' i) <*> 

with R x = I 16 . Then, the sample mean estimate of the mean-square-error ([3]) 
is given by: 

i Q 

J(W) = -£||x Cg -x c J| 2 , ( 3 °) 
W 3=1 

where Q is the number of data blocks, and x Cq is an estimate of x Cg obtained from 
its real- valued representation x g = Wy ? as x C(j = [Is ilg]x g . In figures below, 

we represent the sample mean-square-error (|3T)1) in decibels [10 log 10 J(W)] as 
M5-E[d.B]. Furthermore, we consider below levels of 

SNR[dB] = (-4, -2, 0, 2, 4, 6, 8) 

which corresponds to e values of 

e = (2.51,1.58,1,0.63,0.4,0.25,0.16), (31) 



respectively, cf. (f27|) . 

In the theoretical case of exact model knowledge, we present in Fig[T]a per- 
formance comparison for sample realization of channel H c , where the eigenvalues 



of H'R,, x H are found to be: 



(ui = 14102, v 2 = 14102, v 3 = 550, u 4 = 550, . . . , 

v 13 = 5.1, ui4 = 5.1, vi 6 = 0.43, v 16 = 0.43). (32) 

We note that eigenvalues of H*R n 1 H come in pairs in virtue of the real- valued 
representation via ([28]) - ([29]) . Therefore, using Theorem [2] for R x = Ii 6 (thus 
7, = 1 for i — 1,...,16 in Theorem [5]) from (|31[) and (|3^|) we obtain that 
r opt = 14 for SNR[dB] = (-4,-2,0,2) and r opt = 16 for SNR[dB] = (4,6,8), 
for channel realization as in FigfT] It is also seen that even a relatively mild 
ill-conditioning of H'R^H embodied in the last two trailing eigenvalues indi- 
cates that rank-reduction yields improved performance also for higher values of 
SNR[dB], cf. also comments below Theorem 

Moreover, from Theorem [T] and Remark [1] it is simple to verify that for 
Rx = Ii6 one has from (fl4l) that 



' opt 



= max{s € {1, 2, ... , m} | a a > 0.5} , (33) 



where <ii > u% > • • • > o\& > are the eigenvalues of H f R y 1 H. Thus, from 
Theorem [3] we conclude that if we find CT14 > 0.5 and C15 < 0.5 for certain 
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Figure 1: MSE [dB] vs. SNR [dB] for sample channel realization in theoretical case. 




SNR [dB] 



Figure 2: Monotonical decrease of 015 with decreasing SNR[dB] in theoretical case. The 
threshold is crossed between SNR[dB] = 2 and SNR[dB] = 4. 
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SNR[dB] levels x, y £ {—4, —2, 0, 2, 4, 6, 8} with y < x, then one can set r opt = 
14 without any numerical simulations for all levels of SNR[dB] such that 

y < SNR[dB] < x. 

In particular, the value of CT15 must be monotonically decreasing with decreasing 
levels of SNR[dB], as demonstrated in FigJ5J This can be deducted from the 
proof of Theorem^ which shows that all eigenvalues of K = (H*R y 1 H) — 2R X 
(which may be expressed here as erf 1 - 2 < cr^ 1 - 2 < ■ • • < crfg 1 - 2) grow 
monotonically with decreasing levels of SNR[dB]. 




Figure 3: MSE [dB] vs. SNR [dB] for sample channel realization in practical case. 

We consider now the case where the channel matrix H c is assumed to be 
known at the receiver with error such that H c = H c + E c , where the entries of 
the error matrix E c are i.i.d. drawn from Gaussian distribution with zero-mean 
and variance 10 -4 . Moreover, for the results presented below we assume that 
neither the noise covariance matrix i? nc nor the noise power e are available at 
the receiver side, and we only use the sample estimate of the covariance matrix 
of observed data R y : 

— 1 Q 

^ 9=1 

where Q — 200 is the number of data blocks available. In Fig(3E]we use the 
perturbed version of the channel matrix H c used in FigJT][2l and the same data 
block transmitted, to clearly illustrate the difference between results obtained 
under complete and incomplete model knowledge. 
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0.8 



0.7 - 




0.1 ' 1 1 1 1 1 1 

-4 -2 2 4 6 8 

SNR[dB] 



Figure 4: Monotonical decrease of trig with decreasing SNR[dB] in practical case. The 0.5 
threshold is crossed between SNR[dB] = 2 and SNR[dB] = 4. 

In current settings one cannot use Theorem [5] directly due to unknown R n 
and e. However, we may estimate the last two trailing eigenvalues ciSjCie of 

t 1 ~ ~ ~* —~ _1 ~ 

H R y H via the last two trailing eigenvalues cri5,cTig of H R y H, and sim- 
ilarly as in FigJ5] we shall utilize Theorem [3] to set r = 14 for SNR[dB] — 
(-4,-2,0,2) and r = 16 for SNR[dB] = (4,6,8). The results are presented 
in Fig|3]|4l where in Fig|3] it is seen that the ranks selected remain correct in 

the current settings, as the trailing eigenvalues of H*R y 1 H are not significantly 

~t- — - -1 ~ 

perturbed in H R y H, which is demonstrated in Fig|4J 

Finally, we would like to note that the mildly ill-conditioned matrix H*R n 1 H 
used in simulations above implied that the rank-reduction capability of the 
stochastic MV-PURE estimator provided gain in performance over the stochas- 
tic BLUE estimator in just over half of the SNR[dB] values considered, which 
allowed us to demonstrate transparently the main results of this paper. How- 
ever, the averaged performance (over 10 000 Monte-Carlo runs) demonstrated 
in [22| showed that the stochastic BLUE estimator is on average more severely 
penalized by ill-conditioning of H'Rj^H than in a delicately ill-conditioned 
settings considered in this section. 

5. Concluding remarks 

In the low SNR regime, we proved that the stochastic MV-PURE estima- 
tor achieves drastic improvement in performance over its full-rank version, the 
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stochastic BLUE estimator. This result demonstrates that many of the exist- 
ing applications of the stochastic BLUE estimator may benefit by employing 
instead the reduced-rank approach of the stochastic MV-PURE estimator in 
highly noisy conditions. 
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